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(57) ABSTRACT 

A graphical user interface provides access to communica- 
tions and other applications in a home environment by 
utilizing icons that are consistent with a refrigerator/magnet 
metaphor. A background is displayed on a touch screen, and 
one or more virtual magnets are displayed on the back- 
ground. The virtual magnets may be dragged to new loca- 
tions by a user. Tapping on a virtual magnet activates a 
corresponding application. The virtual magnets can further 
exhibit magnetic properties, such as alternatively repelling 
or attracting one another. When an application is activated, 
an application window is made to appear on the background, 
preferably in the form of a sheet of paper. The corresponding 
virtual magnet can be made to appear to be affixing the sheet 
of paper to the background, thereby reinforcing the 
refrigerator/magnet metaphor. 

54 Claims, 6 Drawing Sheets 
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GRAPHICAL USER INTERFACE FOR 
COMMUNICATIONS 

BACKGROUND 

The present invention relates to graphical user interfaces, 
and more particularly to graphical user interfaces that are 
particularly useful for providing access to family-oriented 
communications applications. 

Communications in one form or another have long played 
a part in the day-to-day home life of individuals and fami- 
lies. These communications might simply be messages to 
oneself, such as recipes and shopping lists, or they may be 
intended to communicate information from one person to 
another (or others), either within the same household or to 
someone outside the house. 

Various types of communication devices have been made 
available for the purpose of making the intended commu- 
nication easier, faster and/or more efficient. Fax machines 
and personal computers (PCs) are examples of such devices. 
By and large, however, these devices are designed for use in 
office-like settings. Thus, for example, a PC usually requires 
enough desk space to hold a keyboard and monitor, and 
possibly also a base unit that houses the computer mother- 
board. 

It is possible to incorporate some of the office-oriented 
equipment into the home for use there as well. Often this 
involves setting up an area of the home that becomes a 
"home office" space (either a separate room, or a portion of 
a room) that is used for home office-related activities. 
Consequently, to make use of this home equipment, one 
must make an effort to go to the home office space. 

Lifestyles typically do not center around the home office 
space, however. One consequence of this is that one might 
at times feel disinclined to make use of the equipment 
because it feels like too much of an effort. Thus, for 
example, one might put off entering recipes into a comput- 
erized recipe organizer, or might avoid going into the home 
office and turning on the computer just to look up a tele- 
phone number that is stored on the PC's hard drive because 
going to the home office space might mean isolating oneself 
from the center of activity in the household. Moreover, 
because the home office space is often not used for other 
purposes, family members cannot reliably leave messages 
there for other family members because there is no assur- 
ance that the message will be noticed (i.e., there is no 
assurance that the intended recipient(s) of the message will 
go to the home office space, thereby enabling them to see the 
message). 

One could attempt to solve this problem by moving the 
communications equipment into a location that would make 
it more readily accessible to family members in their normal 
day-to-day lives. However, such a solution is problematic 
for several reasons. First, as mentioned above, conventional 
equipment often requires more space (e.g., table space and 
the like) than most family rooms can accommodate without 
at least compromising the decor of the room. Moreover, 
many household occupants do not feel comfortable with, or 
are otherwise intimidated by conventional equipment such 
as PCs, which can often require knowledge of how to boot 
up a system, how to select and launch programs, and how to 
gracefully shut down a system. Put another way, the oper- 
ating systems of conventional systems provide a user inter- 
face that is out of place in a home setting. Rather than 
interacting with the equipment in a way that feels natural, 
the user instead has to perform actions associated with a 
desktop metaphor. 
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There is therefore a need to provide communications 
methods and apparatuses that are suitable for use in a home 
setting, and which more naturally fit into existing home life 
behaviors. 

5 SUMMARY 

It should be emphasized that the terms "comprises" and 
"comprising", when used in this specification, are taken to 
specify the presence of stated features, integers, steps or 

10 components; but the use of these terms does not preclude the 
presence or addition of one or more other features, integers, 
steps, components or groups thereof. 

In accordance with one aspect of the present invention, 
the foregoing and other objects are achieved in methods and 

35 apparatuses that generate a graphical user interface. In one 
aspect, this includes displaying a background on a touch 
screen; displaying a first virtual magnet on the background; 
relocating the first virtual magnet from a first location on the 
background to a second location on the background in 

20 response to a drag operation performed on the first virtual 
magnet by a user; and activating an application program in 
response to a tap operation performed on the first virtual 
magnet by the user. Thus, virtual magnets are like real 
magnets in that they can be placed where the user would like 

25 them to appear. 

The graphical user interface can also be made to display 
an application window on the background in response to the 
tap operation performed on the first virtual magnet by the 

3Q user. In some, but not necessarily all, embodiments, the 
application window can be made to appear to be a sheet of 
paper. In some other alternatives, the application window 
can be made to appear to be a plurality of sheets of paper, 
wherein each one of the sheets of paper has a tab portion that 

35 indicates one of a corresponding plurality of applications 
that can be activated. 

Although it is not essential to the invention, the graphical 
user interface can move the virtual magnet from a main page 
location to an application window location in response to the 

40 tap operation performed on the first virtual magnet by the 
user, wherein the application window location is such that 
part of the virtual magnet covers a portion of the application 
window and a remaining part of the virtual magnet covers a 
portion of the background, thereby creating the illusion that 

45 the virtual magnet is affixing the application window to the 
background. In some embodiments it is also possible, at this 
point, to move other virtual magnets to positions alongside 
the application window. This permits the other virtual mag- 
nets to continue to be viewed by the user. 

50 Another feature that can be included in the graphical user 
interface is terminating the application in response to a 
second tap operation being performed on the first virtual 
magnet by the user. In addition to terminating the 
application, the application window should be removed 

55 from the background; and the first virtual magnet can be 
returned to the main page location. If the other virtual 
magnets were moved alongside the application window 
when the application was activated, then terminating the 
application can also include returning them to their earlier- 

60 held positions on the background. 

In other non-essential aspects of the invention, the magnet 
metaphor can be enhanced by performing any combination 
of the following. A predetermined sound (e.g., a "click") can 
be generated in response to a peripheral region of one virtual 

65 magnet coming into contact with a peripheral region of 
another virtual magnet. Virtual magnets can be made to repel 
one another when a peripheral region of one virtual magnet 
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is less than a predetermined distance from a peripheral tors have recognized that in many households, the kitchen is 
region of another virtual magnet. The repelling operation the focal point of family activity. That is, people congregate 
causes the two virtual magnets to be moved such that they in the kitchen when meals are being prepared, when infor- 
are at least the predetermined distance away from each other. rnal meals are consumed, and afterwards when the cleanup 
Alternatively, virtual magnets can be made to attract one 5 is performed. Furthermore, the refrigerator has long been 
another, whereby two or more virtual magneto are moved used as a primitive form of communications center for 
such that a peripheral region of one is made to be in contact household activities with various lists, messages, drawings 
with the peripheral regions of the others. The movement of and photographs being held thereon by magnets or other 
virtual magnets when attracted or repelled can be uniform means * Accordingly, the invention provides methods and 
for all virtual magnets, or alternatively can be made to vary 10 apparatuses suitable for establishing and maintaining the 
as a function of relative masses (or weights) associated with ^ en as the communications center for everyday house- 
virtual magnets ho1 marja g ement * ln P art > lhls 1S preferably brought about 

by equipment that includes a processor and an input/output 

BRIEF DESCRIPTION OF THE DRAWINGS 0°) device. 

1 <■ To ensure that the equipment is not out of place in the 

The objects and advantages of the invention will be kitchen setting, the invention provides for a Graphical User 

understood by reading the following detailed description in lQicddLCG (GUI) that utilizes a refrigerator as a metaphor. As 

conjunction with the drawings in which: mentioned above, the refrigerator has already been used as 

FIG, 1 illustrates an exemplary embodiment of a "main a kind of communications center. Thus, the provision of a 

page" of the GUI in accordance with the invention; 2Q GUI having a refrigerator as a metaphor provides a mecha- 

FIG. 2 is a state transition diagram that shows the high nism for interacting with the communications equipment in 

level design of a virtual magnet in accordance with an a way that feels natural and familiar to each household 

exemplary embodiment of the invention; occupant. 

FIG. 3 is a state transition diagram that shows the high An important aspect of the GUI in accordance with the 

level design of a yellow note in accordance with an exem- 25 invention is the provision of one or more icons that each are 

plary embodiment of the invention; representative of, and have one or more characteristics of, 

FIG. 4 depicts an exemplary embodiment of a subordinate ma S nels - ™ ese icons are henceforth referred to as virtual 

page with an application window, in accordance with the ™ e re u ason f or cl ™ sin g ma S nets as an lC0n ^ 

is because, in the real world, magnets are often utilized to 

invention; _ . ' , * . « t 

m „ . . . , , ,. , .. r m affix various items (e.g., lists, drawings, photographs, 

FIG. 5 is a block diagram of an exemplary organization of m s) t0 onc or morc sides of a refrigerator) thereby 

applications and their relation to the GUI in accordance with me refrigerator int0 a bulletin 5oard of ^ ThuSj 

the invention; and if afi I/Q device faaving the inventive GUI were t0 be 

FIG. 6 is a block diagram of an exemplary embodiment of mounted on a refrigerator, or similar appliance housing, a 

a system that incorporates the GUI based on a refrigerator 35 user wou i d f ee i comfortable with the icon manipulation 

metaphor; techniques required for its utilization. 

DETAILED DESCRIPTION * n a P re f erre d embodiment of the invention, the I/O device 

is a color touch screen, although this aspect is not essential 

The various features of the invention will now be f or practicing the invention: any I/O device capable of 

described with respect to the figures, in which like parts are 40 displaying the various icons described here, and of provid- 

identified with the same reference characters. mg a mechanism for manipulating them (e.g., moving and 

These and other aspects of the invention will now be selecting icons via a mouse or keyboard or remote control 
described in greater detail in connection with a number of device or voice recognition technology) could alternatively 
exemplary embodiments. To facilitate an understanding of be used. The GUI is capable of displaying metaphors of the 
the invention, many aspects of the invention are described in 45 physical world. In particular, the GUI displays one or more 
terms of sequences of actions to be performed by elements virtual magnets. To enhance the metaphor, it is preferred, 
of a computer system. It will be recognized that in each of although not essential, that the virtual magnets be displayed 
the embodiments, the various actions could be performed by on a neutral background (e.g., one that would blend in well 
specialized circuits (e.g., discrete logic gates interconnected with a refrigerator), and that three dimensional (3D) graph- 
to perform a specialized function), by program instructions 50 ics be used to represent them. The GUI may additionally 
being executed by one or more processors, or by a combi- display other metaphors of the real world, such as self- 
nation of both. Moreover, the invention can additionally be sticking "yellow notes". It is preferred that the GUI be 
considered to be embodied entirely within any form of designed to create a look and feel of the familiar situation 
computer readable storage medium having stored therein an that one is confronted with when standing in front of a 
appropriate set of computer instructions that would cause a 55 refrigerator in a kitchen. 

processor to carry out the techniques described herein. Thus, i n another aspect of the invention, the virtual magnets 

the various aspects of the invention may be embodied in function as activation buttons for one or more applications 

many different forms, and all such forms are contemplated that are run by the processor associated with the I/O device, 

to be within the scope of the invention. For each of the The particular applications that should be made available 

various aspects of the invention, any such form of embodi- 60 through the inventive GUI are implementation dependent, so 

ment may be referred to herein as "logic configured to" a specification of these is beyond the scope of the invention, 

perform a described action, or alternatively as "logic that" However, for purposes of illustration, such applications may 

performs a described action. (but need not) include any of the following: a family 

As mentioned earlier, there is a need to provide commu- message application that creates virtual self-sticking "yel- 

nicalions methods and apparatuses that are suitable for use 65 low notes" for leaving notes to oneself or other household 

in a home setting, and which more naturally fit into existing members (the virtual "yellow notes" would be displayed on 

home life behaviors. In addressing this problem, the inven- the same screen as the virtual magnets); a calendar appli- 
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cation for organizing the schedules of household members; These may be small areas on the screen that are given a 

a recipe organizer; a shopping list application that, modest yellow color, on which either some text or a picture 

optionally, can also facilitate locating and/or purchasing the will be displayed. At a predefined area of the yellow note 

listed items from vendors via the Internet; television; radio; 109 (e.g., at the top of the yellow note 109) there may appear 

news and other text/audio/video information on demand 5 a smaller text display to indicate the time and/or date on 

(e.g., available via the Internet or another server); telephone; which the Y ellow note 1° 9 was created - * n preferred 

an address/phone book application; email; and appliance embodiments the image of the yellow notes 109 includes 

control functions (e.g., appliances other than the refrigerator, aspects (e.g., lighting, shading) that give the yellow note 109 

such as washing machine and furnace temperature control). a u 3D ^ e appearance. Again, this is to increase the illusion 

: - . in that the user is dealing with real physical objects. 

FIG. 1 illustrates an exemplary embodiment of a main 1U ^ t . t . , . # t . mt • 

»iaa r l n,Tt i lL i ■ i • , 4 . . The logic that generates each virtual magnet 107 is 

page 100 of the GUI. In the exemplary embodiment, this c , , . c ° . . .. ... 9 t , 

r & .. . , . c . • preferably a set of program instructions that are executed on 

page is delayed on a computer ouch screen haying an * ^ ^^J^ the touch mG 2 is a state 

aspect rauo of 4:3 (w,dlh:height), although these selections m ^ shows ^ ^ de q{ a 

are not essential features of the mvenhon Bemg a touch virtual magnet 107 . default state of a virtual magnet 107 

screen, the input device is neither a keyboard nor a mouse, " . ... °7 . - Ai T . „ . . - ftl t 

r. , • -i * . t_ i- j i * j *i_ is an idle state 201. In idle state 201, the virtual magnet is 

although similar functions can be achieved. Instead, the 1A _ . , , ., , . _ _ 

= i . . <■ , • \ • . . 107 merely displayed on the touch screen, 

screen (which is also the display device) is touch-sensitive, _ . / f , . 

. n c . u • / ** cu Transitions in state are made in response to various 

which allows finger-touch interaction. Such screens are . , . , . f . _ 

i • (L ♦ j a * u a -u~a •„ A~* n ;\ interactions that a user can have with the touch screen. One 

known in the art, and need not be described here in detail. , . , * . . . „ . ■ . • , 

20 of interaction is a tap , which may involve the user 

The background 101 is preferably given a neutral visual touching the surface of the t0lich ^ncn (e.g., with a finger 

effect, such as generally being colored a light gray with a Qr Qther implement __ In this example, a finger is assumed) 

grid of horizontal and vertical lines depicted in white so as and then lifting off from the tQUch screen surface without 

to leave the impression of some kind of board. havifJg moyed the finger from i(s initial point of CQQtact with 

In a predefined area of the screen, such as the upper part, 1$ me toucn scr e 6 n. Where the user interaction is accomplished 

some general information may be displayed in a moderate v i a a remo t e control device, the tap might be accomplished 

gray color. This information may include, for example, the t y f irst selecting the desired virtual magnet 107 (e.g., by 

current time 103 (and perhaps date, not shown) and weather pressing a numbered key on the remote control device that 

forecast 105. The weather forecast may be presented by corresponds to a number associated with the virtual magnet 

means of pictograms (e.g, a sun, a cloud, etc.). All of this 3Q 107) anc j t h en selecting a control key associated with the tap 

general information is preferably depicted as two- command. Where the user interaction is accomplished via 

dimensional (2D) text or graphics, which are subordinated to recognition technology, the user may first select the 

the grid of white lines in the background 101, so that the desired virtual magnet 107 by speaking a number or label 

general information will appear to be a part of the back- associated with the virtual magnet 107 (e.g., "3" or 

ground board. 35 "shopping"), followed by another word to indicate the 

Scattered about the rest of the board are a number of command (e.g., "tap" or "activate"), 

virtual magnets, generally referred to by reference number When the user taps an area of the touch screen upon which 

107. In the exemplary embodiment depicted in FIG. 1, the a virtual magnet 107 is displayed (henceforth referred to as 

virtual magnets 107 have circular shapes with a pictogram in tapping a virtual magnet 107), the logic that controls the 

the center. The pictogram is useful for informing the viewer 40 GUI determines that the tapped virtual magnet 107 is in the 

of the function of the particular virtual magnet 107, as will idle state 201, and in response to the tap launches an 

be described in greater detail below. The image of each application that has been associated with the virtual magnet 

virtual magnet 107 on the touch screen includes 3D effects, i07 j anc j changes the touch screen image so that instead of 

such as light and shadow, so that each virtual magnet 107 displaying the main page 100, a subordinate page is dis- 

gives the illusion of being a real magnet that has been placed 45 played. The virtual magnet 107 is now in an "Application 

on the board. The particular shape and colors of the virtual Running" state 203, which preferably causes the virtual 

magnets 107 are not essential to the invention. In alternative magnet 203 to be displayed at a predefined position on a 

embodiments, the virtual magnets 107 could have many subordinate page. The particular information conveyed by 

different shapes and colors, thus imitating magnets in the the subordinate page is application specific, and so cannot be 

real kitchen environment. In some alternative embodiments, 50 defined here. However, a preferred format for displaying a 

the pictograms can be replaced by giving each virtual subordinate page is described in greater detail later on in this 

magnet 107 one of a number of unique shapes to indicate disclosure. When the user terminates the application (e.g., 

which of a corresponding number of functions the particular by aga i n tapping the virtual magnet 107), the state returns to 

virtual magnet 107 can perform. the idle state 201. 

Referring back to the exemplary embodiment depicted in 55 Another interaction that the user can have with the touch 

FIG. 1, somewhere in proximity to each virtual magnet 107 screen is a "drag", which involves touching the virtual 

(e.g., above or below the virtual magnet 107) is a short magnet (e.g., with the finger or other implement — In this 

written title, which may be the label of the application example, a finger is assumed), and without lifting the finger 

associated with the virtual magnet 107, or even just a from the touch screen, moving the finger to a different 

number associated with the virtual magnet 107 for the 6 o location on the touch screen. The drag is complete when the 

purpose of distinguishing it from other magnets. These user lifts the finger from the touch screen. Where the user 

labels are supplementary to the pictograms depicted in the interaction is accomplished via a remote control device, the 

middle of the virtual magnet 107, and need not be provided drag might be accomplished by first selecting the desired 

in all embodiments. virtual magnet 107 (e.g., by pressing a numbered key on the 

Other images may also appear on the board. For example, 65 remote control device that corresponds to a number associ- 

where a sticky yellow note application has been provided, ated with the virtual magnet 107) and then selecting a 

one or more yellow notes 109 may appear on the board. control key associated with the desired dragging motion. In 
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this case, the drag command can be terminated by the user's several shopping lists, it could be made to behave as a 

releasing the motion command key. Where the user inter- "heavier" object than one that "holds" only one shopping 

action is accomplished via voice recognition technology, the list. In a related, optional feature, the user can be given 

user may first select the desired virtual magnet 107 by access to a "settings" function that permits him or her to set 

speaking a number or label associated with the virtual 5 the weights and/or other magnetic properties of some or all 

magnet 107 (e.g., "3" or "shopping"), followed by another of the virtual magnets 107. 

word to indicate the desired motion (e.g., "move left"). Another virtual magnet state, called the "non-associated 

Like magnets on a real refrigerator, the virtual magnets application active" state 207, is entered .in response to 
107 are moveable. This means that the virtual magnets 107 activation of an application other than the one the virtual 
are not forced to remain in fixed or default positions on the 1° magnet 107 is associated with. In the "non-associated appli- 
main page 100 of the GUI. Rather, the user can use the drag cation active" state 207, the virtual magnet 107 is automati- 
interaction to move a virtual magnet 107 to a different cally repositioned to a predefined default position. The 
position of the object. Thus, in FIG. 2, it can be seen that a particular default position is implementation dependent, and 
virtual magnet 107 in the idle state 201 will transition to a is not essential to the invention. An exemplary default 
magnet movement state 205 in response to a drag operation. 15 position is described in greater detail below in connection 
When the drag operation is complete (i.e., when the finger with an exemplary embodiment of a subordinate page, 
is lifted away from the touch screen surface), the virtual Alternatively, the new position to which any given virtual 
magnet 107 leaves the magnet movement state 205 and magnet 107 is repositioned upon entering the "non- 
returns to the idle state 201. The position of the virtual associated application active" state 207 may be made a 
magnet 107 remains substantially where the user left it, 20 function of its current (main page) position. For example, it 
subject to possible adjustments made by the magnet move- may be alternatively repositioned to the left or the right of 
ment state 205. These adjustments will now be described. the subordinate page, depending on whether the virtual 

To enhance the refrigerator magnet metaphor, the magnet magnet 107 was to the left or the right of center on the main 

movement state 205 may impose restrictions and character- page. The height of the magnet in its repositioned location 

istics on the movements of virtual magnets 107. Thus, in 25 may also be made a function of the virtual magnet's current 

preferred embodiments: (main page) position (e.g., the height may be left relatively 

Virtual magnets 107 cannot be moved outside the screen unchanged, at least relative to other virtual magnets 107). 

area. When the non-associated application is terminated (and 

One virtual magnet 107 cannot be moved to a position that no other non-associated applications are launched), the 

covers any part of another magnet. At most, virtual magnets virtual magnet 107 leaves the "non-associated application 

107 can be made to contact one another at their borders. To active" state 207 and enters the "return to idle" state 209. 

increase the illusion that the user is working with real The "return to idle" state 209 is a transitory state which 

magnets, preferred embodiments incorporate sound effects sen^s only to return the virtual magnet 107 to the screen 

that include the playing of an audible clicking sound when position that it had just prior to entering the "non-associated 

two virtual magnets 107 first come into contact with one application active" state 205. After the virtual magnet 107 

another nas rcturae ^ to i ts former position on the main page 100, its 

Virtual magnets 107 are characterized by a magnetic state returns to the idle state 201 

property that can cause two magnets that are very close to The logic that controls the GUI may also give the yellow 

one another (e.g., within 1 centimeter distance from one 40 notes 109 a set of characteristic behaviors that will enhance 

another) to alternatively attract one another (i.e., the virtual the refrigerator metaphor. This behavior is illustrated by the 

magnets 107 will automatically move quickly towards each state transition diagram shown in FIG. 3. When not being 

other (or one virtual magnet 107 will move towards another activated or moved by a user, a yellow note 109 remains in 

that is "held" in place by user interaction) until they contact an idle state 301. While in idle state 301, relatively short text 

one another) or repel one another (i.e., the virtual magnets 45 messages may be displayed, so that no action is required of 

107 will automatically move quickly away from each other the user to read the message from the main page 100. If the 

(or one virtual magnet 107 will move away from another that message is short enough, it may fit in its entirety in this 

is "held" in place by user interaction) until a predetermined format. However, longer text messages may have only a first 

distance of, e.g., 1 centimeter is reached). Whether virtual portion of the text displayable from the main page 100, with 

magnets attract or reject each other can be determined at 50 the remainder requiring an action by the user in order for it 

random, or alternatively can be determined by default set- to be displayed. In response to a tap, the yellow note 109 

tings for each of the virtual magnets 107. transitions from idle state 301 to a display/play state 303, 

A virtual magnet can be dragged to a spot that covers a whit * displays complete messages, or plays a previously 

yellow note 109 recorded audio and/or video message to the user. Upon 

Different virtual magnets 107 can be assigned different 55 ^P 1 "™ f *e display/play operation, the yellow note 

virtual masses or weights that give them different properties 109 returns to the idle state 301. A preferred yel ow ■note 

when moved and when they interact with one another. For »PPl«*uon for use with the GUI is described in greater detail 

example, a "lighter" virtual magnet 107 can be made to c ow * 

move more quickly than a "heavier" virtual magnet 107 In response to a drag operation, the yellow note 109 enters 

when the two interact with one another magnetically (i.e., 60 a yellow note movement state 305, that permits the user to 

when attracting or repelling one another). This virtual reposition the yellow note 109 on the main page 100 of the 

weight can be made constant, or in some embodiments could touch screen, possibly subject to certain restrictions, which 

be made a function of the number of functions or other ^ be described below. Upon termination of the drag 

applications associated with the virtual magnet 107 (e.g., the operation, the yellow note 109 returns to the idle state, 

more functions associated with the virtual magnet, the 65 In order to enhance the refrigerator metaphor, as well as 

"heavier" it is). For example, if one virtual magnet 107 is to facilitate usage of the yellow notes 109, the yellow note 

made to appear to be "holding'' or otherwise associated with movement state 305 can be designed to impose restrictions 
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and other characteristics on the movement and display of virtual magnets 107 (other than the one that launched this 
yellow notes 109. These may include: application) are automatically moved into default positions 
If dragged to a position that is over a virtual magnet 107, (see "non-associated application active" state 207), pre fer- 
tile virtual magnet 107 is always depicted as being on ably in a vertical row situated alongside the application 
top of the yellow note 109, and never the other way 5 window 401. As for the virtual magnet 107 that launched 
around. m js application window 401, it preferably moves to a top 
A yellow note 109 can be moved to a position that covers position of the rectangular application window 401. To 
one or more other yellow notes 109, but in preferred enhance the refrigerator/magnet metaphor, this virtual mag- 
embodiments, a default minimum vertical displace- net 107 is preferably depicted halfway covering some of the 
ment is caused to exist which ensures that the time and 10 application window 401 and halfway covering some of the 
date stamp on each note will always be visible. background area 101. In this way, the virtual magnet 107 
Upon being created, by default, a new yellow note 109 is will appear to be placed over or in front of the application 
placed above an older yellow note 109, so that if a user window 401, which again by means of a thin outline and 
does not manually move the yellow note objects shadow effect can be made to seem to be in front of the 
around, they will by default be placed in a vertical 15 background board. The metaphor is that the virtual magnet 
column with the newest note on top and the oldest on 107 is affixing the "paper 1 ' of the application window 401 to 
the bottom. the board. 
Another yellow note state, called the "non-associated By arranging a subordinate page in this manner, all virtual 
application active" state 307, is entered in response to magnets 107 will remain visible when an application is 
activation of an application other than the one the yellow 20 activated. This makes it possible to activate another appli- 
note's own play/display application. In the "non-associated cation without first having to close down the currently 
application active" state 307, the yellow note 109 is auto- activated application. Although it is not essential to the 
matically removed from view, to make room for a subordi- invention, in preferred embodiments, it is not possible to 
nate page (described in greater detail below). activate more than one application at a time. When a first 
When the non-associated application is terminated (and 25 application ("application A") is activated, the application 
no other non-associated applications are launched), the window 401 is opened up displaying the information related 
yellow note 109 leaves the "non -associated application . to application A, including its submenus. If the user then 
active" state 307 and enters the "return to idle" state 309. wants to activate a second application ("application B"), this 
The "return to idle" state 309 is a transitory state which is done simply by tapping the screen surface location of the 
serves only to return the yellow note 109 to the screen 30 graphical representation of the virtual magnet 107 associated 
position that it had just prior to entering the "non -associated with application B. This results in an exchange of the virtual 
application active" state 305. After the yellow note 109 has magnets "A" and "B" (e.g., either an immediate exchange, 
returned to its former position on the main page 100, its state or alternatively one that is slow enough to create the illusion 
returns to the idle state 301. to the user that the two virtual magnets "A" and "B" are 
As mentioned earlier, each virtual magnet 107 functions 35 moving in order to exchange places), so that the virtual 
as an activation button for the various software applications magnet 107 associated with application B will now be 
that are made available to the user. An application is "holding" the application window 401, and the virtual 
activated in response to a corresponding virtual magnet 107 magnet 107 associated with application A will return to its 
being tapped by the user. The activation preferably happens default place in the column beside the application window, 
in response to release of the finger (or other touching 40 At the same time, the information and the sub-menus 
implement) from the surface of the touch screen. I preferred displayed in the application window 401 change to infor- 
embodiments, only a single tap is required to launch an ma don relating to the application B. In this way, either 
application. application A or application B is represented in the appli- 

When an application is activated (i.e., "launched"), the cation window 401. 

main page 100 changes so that an application "window" 45 Although in alternative embodiments it could be possible, 

opens up in a subordinate page. An exemplary embodiment in preferred embodiments it is not possible to open up 

of a subordinate page 400 with an application window 401 several application windows 401 on top of each other, 

is depicted in FIG. 4. In preferred embodiments, the appli- Instead, the application window 401 is stable— only the 

cation window 401 is a rectangular white area in which content of the window changes. 

information can be displayed. If the application contains 50 If the user wants to return to the main page 100 (e.g., to 

sub- menus, these are preferably accessed via "tabs" 403 that be able to see the yellow notes 109), tapping once on the 

are displayed in a top portion of the rectangular area. A virtual magnet 107 associated with the currently activated 

default sub-menu (e.g., the "Trafik" sub-menu) is then application causes this to happen. The application window 

opened automatically, and the relevant tab 403 is highlighted 401 will then disappear and the main page 100 is again 

to indicate the chosen sub-menu. The user can open any 55 visible. The main page 100 will appear as it was left at the 

other sub-menu by tapping the screen area of the graphical time the application window 401 was opened. Thus, if the 

representation of the relevant tab. user has arranged virtual magnets 107 and yellow notes 109 

A sub-menu can, itself, have sub-menus, which arc sirai- in his or her personal way, this personal layout will appear 

larly accessed by means of tabs 405. again after closing down the application window 401. 

In preferred embodiments, the rectangular application 60 One of the applications referred to repeatedly in this 

window 401 covers more than half of the screen, and is disclosure is the yellow note application. While it is not an 

placed below the area containing the general information essential feature of the GUI, in preferred embodiments the 

(time/date and weather report, which remain permanently yellow note application is present because it enhances the 

visible). refrigerator metaphor. Preferably, one of the virtual magnets 

As mentioned earlier, whenever an application is 65 107 represents the yellow note application. Tapping on this 

activated, the yellow notes 109 disappear from the screen virtual magnet 107 activates the application for creating new 

(see "non -associated application active" state 307) and the family messages. The preferred yellow note application 
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offers the user the choice between creating a text message or 
creating an audio -visual message, either as video or as a 
voice message. (The selection of a video message may, of 
course, also include audio information.) 

If the user chooses to create a text message, then a text 
area with a blinking cursor will appear and at the same time 
a graphical representation of a conventional computer/ 
typewriter keyboard is displayed, preferably in the lower 
half of the screen. The user can then type in the text area by 
tapping on the touch screen keyboard with his fingers (or 
some other implement). 

After having typed in the desired text message, the user 
completes the process by touching a predetermined one of 
the virtual keys, which may be given a suitable label such as 
"OK", "save" or "close". The touch screen keyboard will 
then disappear and a new yellow note will be visible on the 
main page 100 displaying the text message just typed in. In 
a predetermined portion of the yellow note (e.g., a top 
portion) is a time stamp, put there automatically by the 
computer system running the application to indicate the time 
and/or date of creation of the yellow note 109. To distinguish 
it from the message, the time stamp is preferably presented 
in a smaller font size than the text message, which may be 
displayed just bellow the time stamp. The yellow note 109 
is visible at the main page 100, so that family text messages 
can be seen and read without opening any applications. 

If the user chooses to create an audio-visual message, a set 
of icons representing "record", "stop", "pause" and "play" 
functions will appear instead of the virtual keyboard. By 
activating the "record" function, a built-in microphone, 
either alone or in conjunction with a built-in video camera, 
is used for recording a spoken message from the user. By 
activating "stop", the record function is stopped, and by 
activating "play", the user can check out the recorded 
message. By tapping on a button labeled "OK" (or some 
other suitable indicator), the application window will 
disappear, and there will appear a new yellow note 109 on 
the screen. If the message was recorded as a video message, 
the computer will automatically place a still photo from the 
video sequence on the note, below the automatically inserted 
time/date stamp. The still photo may, for example, be the 
first frame of the video message. If the user left only an 
audio message, the yellow note 109 will show an icon of a 
microphone. 

The audio-visual note will be visible at the front-page 
level just like the text message. However, to hear/see the 
audio-visual message, one has to touch the displayed photo 
or microphone icon represented on the yellow note 109. 
Touching the photo/icon will cause the stored message to 
start playing in a screen window. In this window there can 
also be displayed icons/pictograms representing controls for 
"pause" and audio volume controls. If the user wants to 
see/hear the message again, he or she simply repeats the 
activation process described above. 

The yellow notes 109 can also display a "delete" icon, 
which provides the user with a mechanism for deleting 
outdated or otherwise unwanted messages. 

An "edit" icon can also be presented which provides a 
mechanism for the user to re-open the application and 
change the text or audio-visual message. 

The above discussion has so far described a GUI interface 
that is based on a refrigerator/magnet metaphor for provid- 
ing a mechanism for interacting with home communications 
equipment in a way that feels natural and familiar to each 
household occupant, 'llie virtual magnets 107 have been 
described, which in accordance with the invention exhibit 
magnet-like behavior (i.e., with respect to movement near 
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and away from other virtual magnets 107) and are used to 
activate and de -activate various communications applica- 
tions that may be made available. The description will now 
focus on an exemplary set of communications applications, 
and how they might be organized to provide a complete 
system that is accessible by means of the inventive GUI. An 
exemplary system is depicted in FIG. 5. Three display states 
are possible. In a system idle state 501, the screen is blank. 
The system idle state 501 is entered when no user has 
interacted with the touch screen for some predetermined 
period of time. The purpose of the system idle state 501 is 
to enable the system to conserve energy when it is not in use. 
This may be a requirement in jurisdictions that regulate the 
energy consumption of household appliances. 

The touch screen leaves the system idle state 501 and 
enters the main page display state 503 when something 
comes in contact with it, such as a user's finger, or a sensor 
that detects an approaching user (e.g., a microphone plus 
associated logic that detects the sound of an approaching 
user, or a video camera plus associated logic that detects the 
image of an approaching user). The processor that controls 
the system may at this point start a timer whose function is 
to determine whether the screen has been touched within the 
predetermined period of time. If not, the system returns to 
the system idle state 501. While in the main page display 
state 503, the main page 100 is displayed, as described 
above. It can be seen from FIG. 5 that the user would be 
capable of seeing the pictograms that provide general infor- 
mation (e.g., weather and clock information). Another useful 
pictogram is an SOS button, which when pressed can invoke 
an application that immediately contacts predefined author- 
ity in case of an emergency (e.g., "911" service in the United 
States). 

Also displayed on the main page 100 are various White 
Board items (e.g., any typed notes, voice notes, video notes, 
and/or still pictures and postcards) that may have been 
created by the various messaging applications that are 
available (e.g., a yellow note application). In addition, the 
main page 100 can display notifications that alert the user to 
the existence of incoming telephone calls, received email 
messages, and even problems or other status information 
associated household appliances (e.g., a notification that a 
dishwasher cycle has completed). 

Furthermore, as described in detail above, the main page 
100 displays one or more icons in the form of virtual 
magnets 107, which allow the user to activate any of the 
various applications that are loaded on the processor. In the 
exemplary embodiment, these applications are grouped into 
categories, such as: INFORM AH ON/ENTERTAINMENT; 
COMMUNICATIONS; CALENDAR; TOOLS; SHOP- 
PING; and FOOD. 

When an application is activated (by means of its corre- 
sponding virtual magnet 107), the system enters the appli- 
cation window display state 505, which means that the GUI 
displays the appropriate application window 401 in corre- 
spondence with which application or set of applications was 
selected. In the exemplary system organization depicted in 
FIG. 5, it can be seen that each category of applications has 
a number of associated applications that can be selected 
from the application window by the user. For example, the 
INFORMATION/ENTERTAINMENT group of applica- 
tions may include: WEATHER FORECAST; RADIO; 
TELEVISION (TV) (STREAM); WORLD WIDE WEB 
(WWW); TRAFFIC NEWS/MAP; LOCAL NEWS; and 
GENERAL INFORMATION. 

As indicated by the connecting lines in the figure, the 
COMMUNICATIONS group of applications may include 
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such applications as TELEPHONE FUNCTIONS; E-MAIL; The residential gateway (not shown) is preferably based 

SHORT MESSAGE SERVICE (SMS — a service provided on open industry standard^, and delivers a connection to the 

by GSM and other telephone systems); VIDEO-MAIL; outside world and to appliances in the home. The connection 

VOICE-MAIL; ADDRESS BOOK; YELLOW & WHITE is preferably "Always On", with automatic configuration at 

PAGE DIRECTORY SERVICES; FAMILY'S MAIL BOX; 5 power up. The gateway may also run other applications, and 

and PERSONAL MAIL BOXES. may further include memory for storing household 

As further indicated by the connecting lines in the figure, occupant-related data, 

the CALENDAR group of applications may include such The computer is connected to a screen 611, which is 

applications as FAMILY'S CALENDAR and PERSONAL preferably a color touch screen for displaying the GUI to the 

CALENDAR. The TOOLS group of applications may J(J user , and for receiving the user's touch commands. The 

include such applications as SETTINGS; TIMER; CALCU- screen 611 is preferably mounted at a prominent position on 

LATOR; HELP; GLOBAL SEARCH; and APPLIANCE the a ppii an ce so that it can be readily available to the user. 

CONTROL (e.g for controlling the refrigerator/freezer or For example) ^ embodiments in which the appliance is a 

other apphances)^e ^HOPPING group of apphcaUons is refri tor> the screen 611 is ferabl mounted on the 

exemplified by a SHOPPING LIST application. The SHOP- doo * of me rcfri lor 

PING group of applications might further include, for 15 ™ . & , 4U . . A 4 t . . 

example, an e-commerce applicafion. Finally, the FOOD ™ e COm P"* r m ^ ^ be COnnec [ ed t0 °' her ^ 

group of applications may include such applications as and/ ° r ou P ut devices such as a microphone 613, a loud- 

RECIPES; COOKBOOK; MEALPLAN; TOOLS; and SPE- speaker 615, and a video camera 617. 

OALS. The invention has been described with reference to a 

The above-identified categories and applications are not 20 particular embodiment. However, it will be readily apparent 

intended to be an exhaustive list, nor are they intended to t0 those skil,ed in tne art that il is possible to embody the 

indicate a set of applications that must be included in the invention in specific torms other than those of the preferred 

system. Rather, they are presented merely to show the embodiment described above. This may be done without 

possibilities of what types of applications would be useful departing from the spirit of the invention, 

for making the kitchen (or other room) a communications 25 For exam plc, numerous references have been made to 

center for the house, and how they might be organized by the "yellow notes" throughout the specification. However, it 

inventive GUI. be readily apparent to one skilled in the art that the 

FIG. 6 is a block diagram of an exemplary embodiment of actual color of lhe note * not an essential aspect of -the 
a system that incorporates the GUI based on a refrigerator invention. Rather, the term "yellow note", as used through- 
metaphor. The system is preferably mounted in or on an 30 out this specification including the claims, is intended to 
appliance 601, which may for example be a refrigerator or refer t0 an y ima S e that appears to the user as a familiar type 
other kitchen appliance. However, this is not essential to of note P a P er ' regardless of color, shape or size. While the 
practicing the invention. The appliance could alternatively "yellow notes" depicted herein are rectangular in shape, 
be any appliance or cabinet used in the home or office. It even this is not an essential feature of the invention, which 
could, for example, be a Cordless Screen Phone, such as 35 can easil y accommodate a note image of any shape, 
those that are being developed by Ericsson, and are expected Mso > the above-described embodiments included notifi- 
to become commercially available. Of course, the GUI is catl0ns on the mam P a S e 100 that alert the user to the 
particularly well-adapted for use in a kitchen-like setting. existence of incoming telephone calls, received email mes- 

In addition to equipment (not shown) that might normally sages. However, in alternative embodiments, such notifica- 

be associated with the appliance (e.g., refrigeration 40 tions could be displayed in other manners. For example, an 

equipment), the appliance 601 includes a computer 603 for incoming email message could be displayed as an envelope 

running the GUI and the one or more applications that can that appears to be "held" to the background by one of the 

be accessed via the GUI. The computer 603 may therefore virtual magnets 107 (e.g., the COMMUNICATIONS 

include a processor 605 which is coupled to a memory 607 magnet). In another alternative, the user could be alerted to 

and a communications module 609. The memory 607 stores 45 tne P rese nce of an incoming email message, telephone 

the control program that creates and controls the GUI, and message, and the like by displaying a suitable alerting 

also stores the one or more application programs that can be message (e.g., "You have an email message") next to a 

accessed via the GUI. corresponding virtual magnet 107 (e.g., the COMMUNICA- 

Because one or more of the application programs may TIONS magnet), 

require a link to one or more communications networks, the 50 In vet aoot her alternative, in response to the existence of 

system preferably also includes the communications module a notification for the user, the inventive GUI could cause a 

609. The communications module 609 preferably provides a virlual magnet 107 to appear to move around the 

wireless connection to a residential gateway, a terminal or background, for the purpose of drawing the user's attention 

other appliances. In alternative embodiments, the connec- t0 the GUI > and more particularly to the virtual magnet 107. 

tion may be wired. The residential gateway (not shown) can 55 Thus ' the Preferred embodiment is merely illustrative and 

provide broadband service so that the various applications should DOt be considered restrictive in any way. The scope 

need not experience major delays when providing, for of the invention is given by the appended claims, rather than 

example, television or radio programming to the user. The lhe preceding description, and all variations and equivalents 

communications module 609 can also serve as a vehicle for which fal1 within the ran S e of tne claims are intended to be 

permitting appliance conditions and other status to be moni- 60 embraced therein, 

tored by a remote unit, and also for receiving new or updated What is claimed is: 

application programs to be stored in the memory 607. The L * method of operating a graphical user interface 

application programs can be communication-related pro- comprising: 

grams for direct use by the user, or they may be appliance displaying a background on a touch screen; 

specific programs for those instances in which the computer 65 displaying a first virtual magnet on the background; 

603 is also used to control one or more aspects of the relocating the first virtual magnet from a first location on 

appliance itself. the background to a second location on the background 
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in response to a drag operation performed on the first 
virtual magnet by a user; 
activating an application program in response to a tap 
operation performed on the first virtual magnet by the 
user; 

displaying an application window on the background in 
response to the tap operation performed on the first 
virtual magnet by the user; and 

moving the virtual magnet from a main page location to 
an application window location in response to the tap 
operation performed on the first virtual magnet by the 
user, wherein the application window location is such 
that part of the virtual magnet covers a portion of the 
application window and a remaining part of the virtual 
magnet covers a portion of the background, thereby 
creating the illusion that the virtual magnet is affixing 
the application window to the background. 

2. The method of claim 1, further comprising: 
in response to a second tap operation performed on the 

first virtual magnet by the user, performing the follow- 
ing: 

terminating the application; 

removing the application window from the back- 
ground; and 

returning the first virtual magnet to the main page 
location. 

3. The method of claim 1, further comprising: 
displaying a second virtual magnet on the background; 

and 

moving the second virtual magnet from a second main 
page location to a location that is alongside the appli- 
cation window in response to the tap operation per- 
formed on the first virtual magnet by the user. 

4. The method of claim 3, further comprising: 
returning the second virtual magnet to the second main 

page location in response to a second tap operation 
performed on the first virtual magnet by the user. 

5. The method of claim 1, wherein the step of displaying 
the application window comprises making the application 
window look like a sheet of paper. 

6. The method of claim 1, wherein the step of displaying 
the application window comprises making the application 
window look like a plurality of sheets of paper, wherein each 
one of the sheets of paper has a tab portion that indicates one 45 
of a corresponding plurality of applications that can be 
activated. 

7. The method of claim 1, further comprising: 
displaying a second virtual magnet on the background; 

and 

generating a predetermined sound when a peripheral 
region of the first virtual magnet comes into contact 
with a peripheral region of the second virtual magnet. 

8. A method of operating a graphical user interface 
comprising: 

displaying a background on a touch screen; 
displaying a first virtual magnet on the background; 
relocating the first virtual magnet from a first location on 

the background to a second location on the background 

in response to a drag operation performed on the first 

virtual magnet by a user; 
activating an application program in response to a tap 

operation performed on the first virtual magnet by the 

user; 

displaying a second virtual magnet on the background; 
and 
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causing the first and second virtual magnets to repel one 
another when a peripheral region of the first virtual 
magnet is less than a predetermined distance from a 
peripheral region of the second virtual magnet, 
whereby the first and second virtual magnets are moved 
such that they are at least the predetermined distance 
away from each other. 

9. The method of claim 8, further comprising: 
associating a first mass with the first virtual magnet; and 
associating a second mass with the second virtual magnet, 
wherein a speed of movement of the first virtual magnet 

when the first and second virtual magnets are caused to 
repel one another is a function of how massive the first 
virtual magnet is relative to the second virtual magnet. 

10. The method of claim 9, wherein the first mass is a 
function of how many functions are associated with the first 
virtual magnet. 

11. The method of claim 9, wherein the first mass is a 
constant. 

12. The method of claim 9, further comprising: 
receiving a user input that determines the first mass. 

13. The method of operating a graphical user interface 
comprising: 

displaying a background on a touch screen; 
displaying a first virtual magnet on the background; 
relocating the first virtual magnet from a first location on 

the background to a second location on the background 

in response to a drag operation performed on the first 

virtual magnet by a user; 
activating an application program in response to a tap 

operation performed on the first virtual magnet by the 

user; 

displaying a second virtual magnet on the background; 
and 

causing the first and second virtual magnets to attract one 
another when they are within a predetermined distance 
from one another, whereby the first and second virtual 
magnets are moved such that a peripheral region of the 
first virtual magnet is in contact with a peripheral 
region of the second virtual magnet. 

14. The method of claim 13, further comprising: 
associating a first mass with the first virtual magnet; and 
associating a second mass with the second virtual magnet, 
wherein a speed of movement of the first virtual magnet 

when the first and second virtual magnets are caused to 
attract one another is a function of how massive the first 
virtual magnet is relative to the second virtual magnet. 

15. The method of claim 14, wherein the first mass is a 
function of how many functions are associated with the first 
virtual magnet. 

16. The method of claim 14, wherein the first mass is a 
constant. 

17. The method of claim 14, further comprising: 
receiving a user input that determines the first mass. 

18. The method of claim 1, further comprising: 

using the application program to create a text message; 
and 

displaying the text message on a yellow note that appears 
on the background. 

19. The method of claim 1, further comprising: 

using the application program to create an audio message; 
and 

displaying a yellow note on the background, wherein the 
yellow note includes an icon that indicates that the 
audio message has been recorded. 
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20. The method of claim 19, further comprising: 
playing the audio message in response to a tap operation 

performed on the yellow note by the user. 

21. The method of claim 1, further comprising: 

using the application program to create a video message; 
displaying a yellow note on the background; and 
displaying a first frame of the video message on the 
yellow note, 

22. The method of claim 21, further comprising: 
playing the video message in response to a tap operation 

performed on the yellow note by the user. 

23. The method of claim 1, further comprising: 
displaying a notification of an incoming message on the 

background, wherein the notification is made to appear 
like an envelope that is held to the background by the 
first virtual magnet. 

24. The method of claim 1, further comprising: 
displaying a notification of an incoming message, wherein 

the notification is made to appear as text that is dis- 
played adjacent to the first virtual magnet. 

25. The method of claim 1, further comprising: 
causing the first virtual magnet to move on the back- 
ground in response to a status condition of which the 
user should be notified. 

26. The method of claim 25, wherein the status condition 
is receipt of an incoming email message. 

27. The method of claim 25, wherein the status condition 
is receipt of an incoming telephone message. 

28. A graphical user interface comprising: 
a background; 

a first virtual magnet that is displayed on the background; 
logic that relocates the first virtual magnet from a first 
location on the background to a second location on the 
background in response to a drag operation performed 
on the first virtual magnet by a user; 

logic that activates an application program in response to 
a tap operation performed on the first virtual magnet by 
the user; 

logic that displays an application window on the back- 
ground in response to the tap operation performed on 
the first virtual magnet by the user; and 

logic that moves the virtual magnet from a main page 
location to an application window location in response 
to the tap operation performed on the first virtual 
magnet by the user, wherein the application window 
location is such that part of the virtual magnet covers a 
portion of the application window and a remaining part 
of the virtual magnet covers a portion of the 
background, thereby creating the illusion that the vir- 
tual magnet is affixing the application window to the 
background. 

29. The graphical user interface of claim 28, further 
comprising: 

logic that terminates the application, removes the appli- 
cation window from the background, and returns the 
first virtual magnet to the main page location in 
response to a second tap operation performed on the 
first virtual magnet by the user. 

30. The graphical user interface of claim 28, further 
comprising: 

a second virtual magnet; and 

logic that moves the second virtual magnet from a second 
main page location to a location that is alongside the 
application window in response to the tap operation 
performed on the first virtual magnet by the user. 
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31. The graphical user interface of claim 30, further 
comprising: 

logic that returns the second virtual magnet to the second 
main page location in response to a second tap opera- 
tion performed on the first virtual magnet by the user. 

32. The graphical user interface of claim 28, wherein the 
application window is made to look like a sheet of paper. 

33. The graphical user interface of claim 28, wherein the 
application window is made to look like a plurality of sheets 
of paper, wherein each one of the sheets of paper has a tab 
portion that indicates one of a corresponding plurality of 
applications that can be activated. 

34. The graphical user interface of claim 28, further 
comprising: 

a second virtual magnet that is displayed on the back- 
ground; and 

logic that generates a predetermined sound when a periph- 
eral region of the first virtual magnet comes into 
contact with a peripheral region of the second virtual 
magnet. 

35. A graphical user interface comprising: 
a background; 

a first virtual magnet that is displayed on the background; 
logic that relocates the first virtual magnet from a first 

location on the background to a second location on the 

background in response to a drag operation performed 

on the first virtual magnet by a user; 
logic that activates an application program in response to 

a tap operation performed on the first virtual magnet by 

the user; 

a second virtual magnet that is displayed on the back- 
ground; and 

logic that causes the first and second virtual magnets to 
repel one another when a peripheral region of the first 
virtual magnet is less than a predetermined distance 
from a peripheral region of the second virtual magnet, 
whereby the first and second virtual magnets are moved 
such that they are at least the predetermined distance 
away from each other. 

36. The graphical user interface of claim 35, further 
comprising: 

logic that associates a first mass with the first virtual 
magnet; and 

logic that associates a second mass with the second virtual 
magnet, 

wherein a speed of movement of the first virtual magnet 
when the first and second virtual magnets are caused to 
repel one another is a function of how massive the first 
virtual magnet is relative to the second virtual magnet. 

37. The graphical user interface of claim 36, wherein the 
first mass is a function of how many functions are associated 
with the first virtual magnet. 

38. The graphical user interface of claim 36, wherein the 
first mass is a constant. 

39. The graphical user interface of claim 36, further 
comprising: 

logic that receives a user input that determines the first 
mass. 

40. A graphical user interface comprising: 
a background; 

a first virtual magnet that is displayed on the background; 

logic that relocates the first virtual magnet from a first 
location on the background to a second location on the 
background in response to a drag operation performed 
on the first virtual magnet by a user; 
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logic that activates an application program in response to 
a tap operation performed on the first virtual magnet by 
the user; 

a second virtual magnet that is displayed on the back- 
ground; and 

logic that causes the first and second virtual magnets to 
attract one another when they are within a predeter- 
mined distance from one another, whereby the first and 
second virtual magnets are moved such that a periph- 
eral region of the first virtual magnet is in contact with 
a peripheral region of the second virtual magnet. 

41. The graphical user interface of claim 40, further 
comprising: 

logic that associates a first mass with the first virtual 
magnet; and 

logic that associates a second mass with the second virtual 
magnet, 

wherein a speed of movement of the first virtual magnet 
when the first and second virtual magnets are caused to 
attract one another is a function of how massive the first 
virtual magnet is relative to the second virtual magnet. 

42. The graphical user interface of claim 41, wherein the 
first mass is a function of how many functions are associated 
with the first virtual magnet. 

43. The graphical user interface of claim 41, wherein the 
first mass is a constant. 

44. The graphical user interface of claim 41, further 
comprising: 

logic that receives a user input that determines the first 
mass. 

45. The graphical user interface of claim 28, wherein: 
the application program is a message application that 

creates a text message; and 
the graphical user interface further includes logic that 
causes the text message to be displayed on a yellow 
note that appears on the background. 

46. The graphical user interface of claim 28, wherein: 
the application program is a message application that 

creates an audio message; and 
the graphical user interface further includes logic that 
causes a yellow note to appear on the background, 
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wherein the yellow note includes an icon that indicates 
that the audio message has been recorded. 

47, The graphical user interface of claim 46, further 
comprising: 

5 logic that plays the audio message in response to a tap 
operation performed on the yellow note by the user. 

48. The graphical user interface of claim 28, wherein: 
the application program is a message application that 

10 creates a video message; and 

the graphical user interface further includes logic that 
causes a first frame of the video message to be dis- 
played on a yellow note that appears on the back- 
ground. 

15 49, The graphical user interface of claim 48, further 
comprising: 

logic that plays the video message in response to a tap 
operation performed on the yellow note by the user. 
2Q 50. The graphical user interface of claim 28, further 
comprising: 

logic that displays a notification of an incoming message 
on the background, wherein the notification is made to 
appear like an envelope that is held to the background 
25 by the first virtual magnet. 

51. The graphical user interface of claim 28, further 
comprising: 

logic that displays a notification of an incoming message, 
3Q wherein the notification is made to appear as text that 
is displayed adjacent to the first virtual magnet. 

52. The graphical user interface of claim 28, further 
comprising: 

logic that causes the first virtual magnet to move on the 
35 background in response to a status condition of which 
the user should be notified. 

53. The graphical user interface of claim 52, wherein the 
status condition is receipt of an incoming email message. 

54. The graphical user interface of claim 52, wherein the 
40 status condition is receipt of an incoming telephone mes- 
sage. 

***** 
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